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Decision  Making  with  the  Aid  of  a Subjective  Prior  Distribution 

G.  J.  Schick 
Chi-Yuan  Lin 

University  of  Sou  the  n California 
Abstract 

This  paper  discusses  a methodology  to  establish  a subjective 
prior  distribution  via  an  interactive  computer  program  on  a CRT. 

The  progi^am  asks  specific,  carefully  worded  questions.  The  answers 
to  these  questions  are  checked  for  logical  consistency  and  are  trans- 
lated into  fractiles  of  a subjective  probability  distribution,  ^he 
fractiles  as  well  as  other  summary  measures  (like  the  mean  and 
variance)  are  printed  out.  In  order  to  find  a conjugate  prior  dis- 
tribution for  a Bayesian  treatment,  the  mathematical  fonn  of  a possible 
conjugate  prior  needs  to  be  ascertained.  The  paper  illustrates  how 
the  parameters  of  a lognormal  distribution  might  be  obtained  from 
the  fractiles  of  the  subjectively  derived  prior. 


1.  INTRODUCTION 


Fvery  firr)  experience*:,  once  in  a while,  such  3 heavy  demand  for  some 
of  its  products  or  services  that  leads  to  a complete  sellout.  When  sellout 
occurs,  the  firm  forgoes  potential  profit  and  suffers  possible  loss  Of.od 
will.  Examples  of  this  can  be  seen  in  supermarkets,  in  TV-repair  shops,  and 
at  airline  counters  when  customers  have  to  be  turned  away.  Usually  one  only 
hears  "Sorry,  we  cannot  accommodate  your  wishes." 

Almost  invariably,  no  one  keeps  track  of  unsatisfied  custotr>erj  demand. 

No  one,  however,  denies  the  importance  of  knowing  the  unsatisfied  demand, 
for  no  other  reason,  maybe  the  manager  in  charge  can  do  a better  job  in 
scheduling  available  capacity  for  the  future.  Without  the  data  on  unsatisfied 
demand,  the  manager  must  estimate  future  demand  from  incomplete  data--sale'' 
record  only  in  other  words,  the  distribution  of  future  demand  has  to  be 
estal.>l  ished  friom  truncated  frequency  distribution  of  demand. 

»^ode»  n statistical  decision  analysis  can  help  the  r;anager  establish  a 
prior  distribution  from  incomplete  prior  data  or  no  prior  data  at  ail.  H a 
sample  is  taken,  then  with  the  aid  of  Rayes'  Theorem  the  prior  distribution 
can  he  combined  with  the  likelihood  function  which  reflects  the  sample  infor- 
mation to  obtain  the  posterior  distribution.  The  demand  of  a certain  product 
or  service  can  be  estimated  from  either  the  posterior  distribution  or  the 
prior  distribution  depending  upon  whether  or  not  the  sample  data  ar»  available. 

fine  difficulty  associated  with  the  assessment  of  a prior  distribution  i; 
the  assessor's  inconsistenc ies  which  often  occur  in  respondinq  to  a questionnaire. 
The  question  of  how  to  discover  and  remove  inconsistencies  is  of  general 
interest  to  decision  analysts.  Another  question  of  interest  is  how  to  fit  a 
probability  distribution  through  the  assessed  fractiles  in  order  to  niake  the 
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subseqiient  analysis  more  tractable.  Both  of  these  questions  are  addressed  i-: 
this  paper.  The  paper  offers  two  computer  programs  which  allow  a person  ro 
interact  with  the  computer  via  a graphical  device  (CRT)  during  his  course  cl 
assessment  and  fit  a theoretical  probability  distribution  through  the  asse's- 
points. 

2.  PREVIOUS  WORK 

In  the  past  the  researchers  were  particularly  concerned  with  t**e  mpthodo’- 
of  Bayesian  analysis,  the  question  was  how  Bayes'  theorem  can  be  used  to  sta-'t 
with  a prior  distribution  and  using  experimental  data  to  derive  the  poste  or 
distribution  (see,  for  example,  [5],  [14]  and  [16]).  Usually  the  researrnrrs 
started  with  an  assumed  distribution,  say  the  Bernoulli,  Poisson,  or  norn.a  1 
and  then  using  the  Bayesian  methodology  to  derive  a particular  posteri'>r 
distribution  [2].  During  recent  years,  however,  considerable  atterifiou  has 
been  given  to  methods  for  assessment  of  a prior  distribution.  Subjective 
probability  has  been  studied  by  researchers  in  various  disciplines  such  is 
psychology,  mathematics,  statistics,  engineering,  and  business  ddminis*^’'dtion 
(see  reference  at  the  end  of  the  paper).  While  some  of  these  studies  are 
mainly  theoretical  or  philosophical,  others  are  experimerita 1 . 

In  their  text  [14],  Pratt,  Raiffa,  and  uchlaifer  present  the  method  of 
equally  likely  subintervals.  Subsequently,  Raiffa  [15]  illustrates  this 
method  in  detail  by  providing  a dialogue  between  a decision  analyst  and  his 
client.  Schlaifer  [19]  advocates  this  method  and  offers  a computer  program 
^or  fitting  a cumulative  function  through  assessed  fractiles. 

The  experimental  study  conducted  bv  Winkler  [23]  considers  four  assessment 
techniques:  (a)  Cumulative  Distribution  Function--assessment  of  fract’iles  bv 
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mearv;  of  equally  likely  subintervals  or  direct  questions  regarding  frac tiles, 

(b)  Hypotnetical  Future  Samples,  (c)  Equivalent  Prior  Sample  Information,  and 
(d)  Probability  Density  Function.  A questionnaire  using  these  techniques  wa>: 
developed  and  used  to  elicit  prior  distributions  from  38  selected  subjects 
involved  in  Winkler's  study. 

The  use  of  penalty  functions,  or  scoring  methods,  has  been  discussed  by 
several  researchers  as  means  of  encouraqinq  honest  assessments.  Specifically, 
de  Finetti  (3)  presents  the  quadratic  scoring  rule.  Savage  [18]  derives  thp 
general  class  of  strictly  proper  scoring  rules  by  considering  probabilities 
as  special  cases  of  rates  of  substitutions.  Winkler  discusses  the  use  of 
scoring  rules  and  other  payoff  schemes  in  [34]  and  reports  Ins  experimental 
results  in  [25]. 

Stael  vcn  Holstein  and  his  associates  ([20]  and  [21])  focus  on  the  subject 
of  eliciting  tne  opinions  of  experts  in  practical  situat  ons  rather  than 
labor.atory  experiments.  They  discuss  probability  encoding  in  the  contcx''  of 
decision  analysis  and  propose  the  use  of  a probability  wheel  to  facilitate 
the  encoding  process. 

At  the  Reliability  Conference  in  1970,  Lin  and  Schick  [10]  presented  the 
use  of  an  on-line  computer  system  to  assist  a person  in  assessing  a prior 
distribution,  which  is  illustrated  by  a problem  in  the  reliability  field. 

Again  in  1974,  Lin  and  Schick  [11]  showed  how  a subjective  probability  distri- 
bution can  be  derived  in  the  field  of  maintainability  and  showed  how  it  can  be 
used  by  the  maintainability  engineer  in  everyday  decision  making. 

The  present  paper  results  from  the  authors'  continued  effort  in  making 
the  probability  assessment  more  practical  by  using  modern  electronic  computers. 
This  paper  first  offers  a newly  designed  computer  program  which  has  incorporated 
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the  experience  gained  from  the  use  of  the  previous  program.  To  simplify 
the  assessment  procedure,  the  new  program:  (1)  reduces  the  number  of  questions 
significantly,  (2)  is  highly,  conversational  and  interactive,  (3)  checks  for 
consistency  as  the  user  answers  question  by  question,  (4)  uses  graphical 
display  rather  than  the  typewriter  terminal  to  help  the  user  observe  the 
assessment  process  as  well  as  to  greatly  increase  the  speed  drawing  the 
assessed  probability  curves,  and  (5)  plots  not  only  the  cumulative  function 
but  also  the  density  function.  The  paper  also  considers  the  question  of 
how  to  fit  a theoretical  distribution  to  a subjectively  derived  di stribu* ion. 
Specifically,  it  uses  a lognormal  distribution  to  illustrate  how  the  fit  can 
be  performed,  and  presents  some  preliminary  findings  of  a research  project 
which  investigates  the  fitting  procedure. 

3.  METHOD  OF  PROBABILITY  ASSESSMENT 

A number  of  methods  have  been  suggested  for  the  assessment  of  prior- 
distributions  (see,  for  example,  [6],  [14],  and  [23]).  Our  computer  program 
makes  use  of  the  method  of  equally  likely  subintervals,  which  perhaps  is 
the  most  commonly  used  approach.  The  basic  idea  of  this  method  is  to  ask 
the  decision  maker,  at  any  stage,  to  divide  a given  interval  into  two 
judgmentally  equally  likely  subintervals. 

To  begin  with,  the  interval  covering  all  possible  values  of  an  uncer- 
tain quantity  (usually  called  a random  variable)  is  split  into  two  suhintervels 
and  the  decision  maker  is  asked  to  choose  which  subinterval  to  bet  on. 

The  dividing  point  is  then  changed  until  he  feels  indifferent  between 


bptting  on  one  or  the  other  subinterval.  When  the  indifference  point  is 
reached,  the  decision  maker  feels  that  it  is  equally  likely  that  the  actual 
value  of  the  uncertain  quantity  will  fall  above  (to  the  right  of'  or 
below  (to  the  left  of)  this  point.  The  indifference  point,  which  divides 
the  entire  interval  into  two  subintervals  with  equal  probabilities,  is 
the  median.  Next,  the  decision  maker  is  asked  to  specify  a pent  which 
will  further  divide  the  subinterval  to  the  left  of  the  median  into  two 
equally  likely  parts.  This  new  point  is  the  first  quartile.  Similarlv. 
the  subinterval  to  the  right  of  the  median  may  be  further  divided  into  two 
equally  likely  parts.  The  decision  maker  may  proceed  in  this  manner  to 
divide  any  given  interval  (generated  previously)  into  two  equally  likely 
subintervals . 

Suppose  we  let  X|^  designate  the  k^^  fractile  of  the  uncertain  quai  t'ty 
X , 1 . e . , 

P(x  1 X|^)  = k,  0 < k £ 1 . 

Then,  using  the  method  of  equally  likely  subintervals,  the  decision  make’" 
is  asked  to  respond  to  a series  of  questions  which  will  lead  to  a determin- 
ation of  X|^  values  for  such  k as  .5,  .25,  .75,  etc. 

4.  COMPUTER  PROGRAM  AND  OUTPUT  FOR  PROBABILITY  ASSESSMENT 

The  program  stores  a set  of  questions  for  the  method  of  equally 
likely  subintervals.  These  questions  are  displayed  successively  on  a CRT; 
the  user  responds  to  the  questions  by  typing  his  anwers  on  a teletype.  The 
response  to  each  of  the  questions  is  processed  immediately  and  checked  for 
logical  consistency. 
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Assuming  you  are  the  user  of  the  program,  the  first  question  calls 
for  the  lower  limit  of  the  probability  distribution  by  askinn  you  to: 

"Specify  the  largest  value  such  that  you  feel  virtually  certain 
that  the  actual  value  of  the  uncertain  quantity  will  fall  above 
this  value." 

The  second  question,  on  the  other  hand,  calls  for  the  upper  limit  of  the 
distribution  by  asking  you  to: 

"Specify  the  smallest  value  such  that  you  feel  virtually  certain 
that  the  actual  value  of  the  uncertain  quantity  will  fall  below 
this  value." 

In  terms  of  the  fractile  notation  described  earlier,  the  first  question 
asks  for  Xq  and  the  second  question  asks  for  x^.  The  program  will  check  to 
see  if  Xq  is  less  than  Xj  and  if  you  feel  virtually  certain  that  the  actual 
value  of  the  uncertain  quantity  will  lie  in  between  Xq  and 

The  third  question  asks  you  to  divide  the  interval  defined  by  the  limi 
Xq  and  x^  into  two  equally  likely  subintervals.  The  question  says: 

"Specify  the  value  such  that  you  feel  it  is  equally  likely  that 
the  actual  value  of  the  uncertain  quantity  will  fall  above  or 
below  this  value." 

The  answer  to  this  question  yields  x g,  which  should  lie  in  between  Xq  and 

X]. 

The  fourth  question,  which  calls  for  x 25.  is: 

"Suppose  you  were  told  that  actual  value  is  less  than  x 5.  Specify 
the  value  such  that  it  is  equally  likely  that  the  actual  value  ot 
the  uncertain  quantity  is  either  above  or  below  this  value." 

The  program  will  check  to  see  if  this  answer  lies  in  between  Xq  and  x 

The  fifth  question,  which  calls  for  x is: 

"Suppose  you  were  told  the  actual  value  is  greater  than  x r.  Specify 
the  value  such  that  it  is  equally  likely  that  the  actual  value  of 
the  uncertain  quantity  is  either  above  or  below  this  value." 

This  answer  is  checked  to  see  if  it  lies  in  between  x c and  x,. 
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At  this  point,  the  progrem  further  checks  for  consistenc/.  jpeci fif a1 1 y , 
i t asks: 

"Now,  do  you  feel  it  is  equally  likely  that  the  actual  value  of  the 
uncertain  quantity  will  lie  within  the  interval  between  x and 
X yg  or  outside  of  this  interval?" 

If  the  check  is  not  met,  the  program  will  direct  you  to  review  and  revise 
each  of  your  orevious  answers.  Otherwise,  the  program  will  proceed  to 
ask  you  to  specify  the  most  likely  value  (the  mode). 

The  assessments  thus  obtained  are  summarized  on  the  ORT.  The  proc)'-.  m 
then  fits  a smooth  cumulative  distribution  function  through  the  assessed 
fractiles.  At  your  request,  it  will  plot  the  cumulative  curve  and  the 
corresponding  density  curve.  If  these  graphs  do  not  seem  to  refle't  you’" 
judgements  about  the  uncertain  quantity,  you  will  be  guided  by  tne  proqran 
to  revise  your  previous  responses.  Whenever  you  are  satisfied  with  ttie 
assessed  distribution,  the  mean  and  the  standard  deviation  are  ornputed. 

In  addition,  you  may  ask  for  .005,  .015,  .025,...,  .995  fractiles  of  the 
distri bution. 

To  illustrate  the  computerized  .method  of  probability  assessment 
discussed  above,  the  computer  output  of  an  example  is  presented.  In  this 
example,  the  expert  (a  manager  in  charge  of  scheduling  a service)  is  asked 
to  quantity  his  judgments  concerning  the  number  of  people  reguesting  a 
particular  service.*  As  can  be  seen  from  this  output,  the  expert  violates 
some  of  the  axioms  of  probability  and  is  asked  to  revise  his  responses 
several  times. 


*The  probability  distribution  cf  the  number  of  people  is  actually  a discrete 
function.  However,  a continuous  distribution  is  used  to  approximate  the 
discrete  distribution  in  order  to  simplify  the  assessment  procedure  and 
the  analysis  of  the  service  problem. 
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variamcl  or  thl  pfioPAiu i i t r ijiSTbibui  lou  oniAiuro  imis  quart  if icatio:;, 

AND  (C)  FirriNO  THE  ASSESSlD  D I S I li  I DUT I ON  TO  A THfcOKLIICAL  D I ST Kl DU  I I ON . 
WHAT  IS  THE  UNCERTAIN  QUANTITY  OF  YOUR  CONuEkN  HOW? 
number  of  customers  requesting  a particular  service^ 


PLEASE  RESPOND  TO  THE  fOLLOWIHG  QUESTIONS  WITH  YOUR  CARETUL  JUDGMENTS: 


(1)  SPECIFY  THE  LAFSEST  VALUE  SUCH  THAT  YOU  EEEl  VIRTUALLY  CERTAIN  THAT 
THE  ACTUAL  VALUE  OF  THE  UNCERTAIN  QUANTITY  WILL  FALL  ABOVE  THIS  VALUE. 

3'i0 

(2)  SPECIEY  THE  SMALLEST  VALUE  SUCH  THAT  YOU  FEEL  VIRTUALLY  CERTAIN  THAT 
THE  ACTUAL  VALUE  OF  THE  UNCERTAIN  QUANTITY  WILL  FALL  BELO'W  THIS  VALUE. 

260 

SORRY,  YOU  HAVE  MISINTERPRETED  THESE  TWO  QUESTIONS.  QUESTION  (I)  ASKS  fCR 
THE  LOWER  LIHIT  OF  THE  UNCERTAIN  QUANTITY.  PLEASE  GIVE  YOUR  NEW  ANSWER  TO 

260 


r»lirrT»A*t  — 

V*-/  Iiiu  viiun  uMili  L'l  lilL  V/Q.MH(|iy.  f'LC.M:?C  ’jlvC. 

YOUR  NEW  ANSWER  fO  (2) . 

3^)0 

YOUR  ANS'WF.RS  TO  THESE  TWO  QUESTIONS  IMPLY  THAT  YOU  FEEL  VIRTUALLY  CERTAIN 
THAT  THE  ACTUAL  VALUE  OF  THE  UNCERTAIN  QUANTITY  WILL  LIE  IN  BETWEEN  2oC 
AND  31)0.  DO  YOU  A'~SLE? 

no 

THEN  YOU  MUST  REVISE  YOUR  ANSWER(S). 

PLEASE  TYPE  YOUR  NEW  ANSWER  TO  (l). 

2^0 

PLEASE  TYPE  YOUR  NEW  ANSWER  TO  (2). 

3'<0 

(3)  SPECIFY  THE  VALUE  SUCH  THAT  YOU  FEEL  IT  IS  EQUALLY  LIKELY  THAT  THE  ACTUAL 
VALUE  OF  THE  UNCERTAIN  QUANTITY  WILL  FALL  ABOVE  OR  BELOW  THIS  VALUE. 

280 

^user's  responses  arc  in  small  letters 
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(^)  SUPPOSE  YOU  wLRl  lOLD  IIIAI  THL  ACIUAL  VALUL  IS  LESS  PHAn  28j. 

SPECIFY  THE  EAlUL  SUCH  THAT  IT  IS  ! QUA  ELY  LIICELY  THAT  THE  ACTUAL  'Jh'A 
OF  (ME  UHCERlAltl  ciUAHTIlY  iS  EITHER  ABOVE  OK  HELOw  THIS  VALUE. 


I BELIEVE  YOU  OIDM'T  /'USWEP.  THIS  QUESTION  CAKEfULLY.  PLEASE  GIVE  IT  SOVL 
THOUGHT. 

DO  YOU  NOW  REALIZE  WHAT  YOU  DID  WRONG? 


no 

YOUR  ANSWER  TO  (A)  SHOULD  HAVE  LIED  IN  BETWEEN  2'iO  AND  280. 
PLEASE  TYPE  YOUR  NEW  ANSWER. 


(5)  SUPPOSE  YOU  WERE  TOLD  THAT  THE  ACTUAL  VALUE  IS  GREATER  THAN  280. 

SPECIFY  THE  VALUE  SUCH  THAT  IT  IS  EQUALLY  LIKELY  THAT  Tr.E  ACTUAL  VALUE 
OF  THE  UNCERTAIN  QUANTITY  IS  E I THEK  ABOVE  OR  BELOW  THIS  VALLi'. 


300 


(6)  NOW,  DO  YOU  FEEL  IT  IS  EQUALLY  LIKELY  THAT  THE  rf 

UNCERTAIN  .^ilJAN'ilT.  WILL  LIE  WITHIN  THE  INTERVAL  JlTWFEN  2 / J AND  300 
OR  OUTSIDE  OF  THIS  INTERVAL? 


SORRY,  YOUR  NO  ANSWER  INDICATES  THAT  YOUR  ANSlVERS  TO  QUESTIONS  (3)  THRjL'C'i 
(5)  MAY  NOT  REFLECi  YOUR  PROBABILITY  JUDGMENTS.  SO,  LET'S  REVIEW  EACH  Of 
THESE  ANSWERS. 

(3A)  ACCORDING  TO  YOUR  ANSWER  TO  QUESTION  (3),  YOU  FEEL  IT  IS  EQUALLY 
LIKELY  THAT  THE  AClUAl.  VALUE  OP  THE  UNCERTAIN  QUANTITY  WlL  PALL 
ABOVE  OR  BELOW  230,  DO  YOU  AGREE? 

yes 

('(A)  we  NOW  LOOK  AT  YOUR  ANSWER  TO  QUESTION  (A).  IF  THE  ACTUAL  VAL'JE  OF 
THE  UNCERTAIN  QUANTITY  WERE  LESS  THAN  260,  WOULD  YOU  FEEL  EQU9LLY 
LIKELY  THAT  THE  ACTUAl  VALUE  IS  CITHER  ABOVE  OR  BELOW  270? 


PLEASE  TYPE  YOUR  NEW  VALUE  fOR  WHICH  YOU  WOULD  FEEL  EQUALLY  LIKELY. 

265 

(5A)  FINALLY,  YOUR  ANSWER  TO  QUESTION  (5)  IMPLIED  THAT  IF  THE  ACTUAL  VlUf. 
OF  THE  UNCERTAIN  QUANTITY  WlRL  GREATT.R  THAN  280  vou  WOULD  FELL  EQUALLY 
LIKELY  THAT  THE  ACTUAL  VALUE  IS  CITHER  ABOVE  OR  BELOW  300.  DO  YOU 
STILL  AGREE? 


yes 
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(GA)  NOW,  LLT'S  CHECK  THE  CONSISTENCY  OF  YOUR  REVISED  ANSWERS.  THE  LOGICAL 
CONSISTENCY  REQNII.LS  YOU  TO  fCLL  EQUALLY  LIKELY  THAT  THE  ACTUAL  VALUE 
or  THE  UNCERTAIN  ^^UANTITY  WILL  LIE  WITHIN  THE  INTERVAL  OETV/EEN  265 
AND  300  OR  OUTSIDE  OF  THIS  INTERVAL.  DO  YOU  FEEL  THAT  WAY? 


yes 

(/)  SPECIFY  THE  HOST  LIKELY  VALUE  (THE  NODE). 

275 

(8)  GREAT.  YOU  NOW  HAVE  DONE  YOUR  ASSE5SHENF5  AS  SUHHARIZED: 


CUM.  PROB. 

VALUE 

CORRESP 

0. 

?A0 

1 

.25 

265 

h 

.50 

280 

3 

.75 

300 

5 

1.00 

3'iO 

2 

MODE 

275 

7 

FROM  THESE  ASSESSED  POINTS,  A SMOOTHED  CUMUL.ATIVE  DISTRIBUTION  WILL  BE  C'TA 
WOULD  YOU  LIKE  JO  SEE  THE  GRAPHS  FOR  THE  D 1 ST  R I BUT  I CN  TUHCTION  AND  THE 
FUNCTION? 

yes 


figure  1 Distribution  and  Density  Functions  for  Customers  Requesting 

a Particular  Service 
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(9)  V.’OIILD  you  ACCHM  f'l' SI.  GRAf  IIS  AS  r.CASONAHLY  ACCUKAU  tXf’RLSS  I OUS  C'K 
YOl'K  JUDf.MLfJiS  COnU.KMIlJG  1 liL  UUSLKIAIN  tlUANllTY? 


(10)  SUM.'IARY  MfASUIU.S  OF  THIS  i)  I ST  R I BU  f I OU  ARE: 

MEAN  283.0'i39 

STAfiOARO  DEVIAnOU  Z'i.OGyG 

(11)  DO  YOU  V/AUT  TO  SEE  VARIOUS  TRACTILES  OF  THE  D I S 1 R I OUT  I Oil 
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(12)  DO  YOU  WANl  10  m THE  ASSESSED  D I ST  lU  BUT  I CO  TO  A THEORETICAL 
Dl STRIBUTION? 


no 

DO  YOU  WISH  TO  QUAflTIFY  YOUR  JUDGMEHTS  CONCERIIIHC  AHY  OTHER  UMCERTAIH 
QUANTITY? 

no 

THANK  YOU  FOR  YOUR  COOR!  RA T I ON . GOOD-BVE. 


To  quantify  his  judgement  about  customer  demand  at  peak  periods, 
the  expert  mav  want  to  use  the  above  assessment  technique  several  times 
until  he  feels  comfortable  with  the  limits  of  the  distribution.  It  should 
be  noted  here  that  nothing  is  assumed,  about  the  nature  o'^'  the  prohabil^tv 
distribution  that  is  being  assessed.  For  instance  a rathe*-  skewed  distri- 
bution might  underlie  customer  demand  and  our  purpose  simply  was  to  ask  the 
expert  to  give  us  his  best  estimates  of  some  of  *^h?se  fractiles.  The 
program  then  gives  us  a printout  of  various  fractiles  of  this  disf ributirn. 
Next,  let  us  consider  what  one  might  want  to  do  with  these  fractiles  or 
summary  measures  of  the  assessed  distribution. 


5.  FIT  OF  A lOGNORMAL  DISTRIBUTION  TO  A SUBJFCTIVE  DISTRIBUTTON 

The  density  function  of  the  lognormal  distribution  is  given  by: 

X > 0 (1) 

B > C 

It  is  well  known  that  the  mean  E(x)  and  the  variance  V(x)  are  given  by; 


E(x)  = u = exp(a  + (b)B^) 
V(x)  = = P^[exp  6^  - 1] 

Ihe  mode  of  this  distribution  is  at 

MODE  = explu  - B^] 


While  the  median  or  50th  percentile,  D^q,  is  at 


By  letting  y = 


50 

In  X - rt  . 


= e\ 

in  (1)  the  90th  percentile  was  found  to  be 


PgQ  = exp (1.282  + a). 

Other  fractile  points  can  be  found  in  similar  fashion. 
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From  the  assessment  p»'ocedure  given  ea>^1ier,  several  fractile  points  or 
the  mean  and  the  variance  are  available  in  the  summary  output  of  the  first 
computer  program.  Any  two  fractile  points,  or  a fractile  point  and  the  mear, 
or  a fractile  point  and  the  variance  etc.,  can  be  used  to  detemiine  the 
parameters  of  the  lognormal  distribution.  A second  orogram  was  develop^'d 
that  allows  some  20  different  input  combination  pairs  in  the  procedure  for 
determining  the  parameters  of  the  lognormal  distribution.  The  program  also 
integrates  over  prespecified  ranges  and  plots  the  function  with  the  rewly 
found  parameters.  A typical  output  is  displayed  on  the  following  two  paoes. 

A plot  of  the  distribution  ^unction  is  also  available.  Now  this 
distribution  function  can  oe  visually  compared  with  the  .subjectively 
derived  prior  distribution  using  the  questionnaire  involving  the  demand 
for  service.  If  "reasonable"  agreement  has  been  achieved  the  mathematical 
form  of  the  densUy  has  been  found.  This  form  is  important  in  order  to 
establish  with  the  incoming  data  and  the  likelihood  function  via  Raves' 
theorem  the  posterior  distribution.  On  the  other  hand,  if  "reasonable" 
agreement  between  the  two  distribution  functions  has  not  been  acnieved  the 
assessment  procedure  starts  anew.  Ultimately,  agreement  will  be  found  unless 
the  lognormal  distribution  is  not  a valid  model  describing  customer  demand. 

But  considerable  research  points  to  the  fact  that  customer  demand  for  services 
at  peak  periods  is  indeed  lognormally  distributed. 

To  fit  a lognormal  distribution  to  a subjectively  derived  distribution 
will  make  subsequent  analysis  of  the  problem  of  satisfying  customers  demand 
more  tractable  rnathemati cal ly.  However,  there  is  no  standard  procedure 
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LOG  fJOP.tiAL  UI  STRI  AUTl  ON 


\niAT  IS  THE  IfJPUT  COMniMATU'.:!  NUMBER  715 
lir,AN=  72B3.0A39 
STD.  DEV.=  72A.0676 

90T!i 

AEP)!A  BETA  NED  I AN  MEAN  STD  PEV  MODE  PCTLE  ri 

5.6A2A  0.0300  282.1396  233.0939  2A.0676  280.3397  312.61  1C 

D0  YOU  V7IS>1  TO  INTEGRATE-mJ^-O,  YES=  I ^ RETURN  = 2 70 
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for  perfoniiing  the  tit.  The  results  and  progress  of  our  -esearch  on  this 
subject  are  sumnarized  as  follows*; 

(1)  To  fit  a two- parameter  lognormal  distribution  to  a subjective  distr:- 
bution,  any  two  values  of  the  subjective  distribution,  such  as  .50  fractile 
and  .90  fractile,  or  mean  and  standard  deviation,  will  be  sufficient  to 
determine  the  two  parameters  and  hence  to  specify  the  lognonr.al  distribution 
completely.  However,  our  study  has  revealed  that  different  sets  of  input 
values  will  yield  different  parameter  values  and  hence  a different  "goodness 
of  fit." 

(2)  Since  there  are  numerous  sets  of  input  values  that  can  be  used  to 
determine  the  parameters  of  the  lognormal  distribution,  an  important  guestior 
arises:  Is  there  a particular  set  of  input  values  that  will  ccnsistantly 
yield  the  best  fit?  To  investigate  this  question,  twenty-eight  sets 

input  values  from  each  of  the  two  subjective  distributions  were  used  to 
fit  lognormal  distributions.  A test  statistic  for  goodness  of  fit  was 
computed  for  each  of  the  fifty-six  lognormal  distributions.  However,  no 
significant  relationship  between  the  goodness  of  fit  and  the  set  of  input 
values  was  detected. 

(3)  Although  only  two  values  of  a subjective  distribution  are  needed  to 
fit  a lognormal  distribution,  more  than  two  values  rriay  be  used  ^nr  thi  ■ 
purpose.  Thus,  an  alternative  method  of  fitting  a loqnornal  distribution 
was  explored.  Specifically,  the  steepest  descent  mett.oo  was  used  to  fit  a 
lognormal  distribution  to  five  fractile  points  of  a ''ubjective  distribution. 
We  are  currently  examining  whether  a better  fit  can  be  obtained  by  using 
this  method. 

(4)  We  have  begun  to  explore  the  possibility  and  desirability  of  fitting 

a three-parameter  or  four-parameter  lognormal  distribution  to  a subjec^^ive 
distribution. 


Details  of  the  research  sponsorea  by  the  Office  of  Naval  Research  will  be 
presented  in  a separate  paper,  "Alternative  Methods  of  Fitfinq  a Lognormal 
Distribution  to  a Subjective  Prior  Distribution,"  by  C.  Y.  Lin  and  G.  J. 
Schick. 


-17- 


REFCRtNCEo 


[1]  Alpert,  M. , and  Raiffa,  H. , "A  Progress  Report  cn  the  Training  of  Probability 
Assessors,"  Unpublished  manuscript.  Harvard  University,  19A9. 

[2]  Bayes,  Thomas,  "Essay  Towards  Solving  a Problem  in  the  Doctrine  of  Chances,' 

The  Philoeophia,iL  Tr'msactiom', , Vol.  53,  pp.  370-418,  1763. 

[3]  de  Mnetti,  Bruno,  "Poes  it  Make  Sense  to  Speak  of  'Good  Probability  Appraisers'?, 

in  The  Oeientist  5vejuiati.r:  An  Aniholug^  of  Far- Ij-Baked  Ideae,  I.  J.  Good, 

ed. , pp.  357-364,  Basic  Books,  New  York,  1962. 

[4]  Edwards,  Ward,  "A  Bibliography  of  Researcn  on  Behavioral  Decision  Processes 
to  1968,"  Me.n.'r(xn-iun  Fepori.  Ih.  7,  Human  Performance  Center,  University  of 
Michigan,  January  1969. 

[5]  Edwards,  W. , Lindman,  H. , and  Savage,  L.  J.  , "Bayesian  Statistical  Inferenre 
for  Psychological  Research,"  Psjohologioal  Review,  Vol.  7'J,  pp.  193-242,  196,, 

[b]  Good,  Irving  John,  The  Ectination  of  Pi'obabi iitia’ — An  Essay  on  flrdert: 
r-iyes-fs-i  Methods,  The  M.I.T.  Press,  Cambridge,  1965. 

[7l  Grayson,  Charles  Jackson,  Dec'si'^ns  loiaer  Unoertaintj:  urilling  Dc.-'.-'  ns  by 
el  and  .>as  Operators,  Harvard  University,  Division  of  Research,  Graduate 
Sc'iool  of  Business  Administration,  Boston,  1961. 

[8)  Howard,  Ronald  A.,  "The  Foundations  of  Decision  Analysis,"  IEEE  Tra-'.s  art  ions 
i.n  Systems  Soicn-.-c  o^ra  Cybevne.tios , Vol.  SSC-4,  No.  3,  Seotember,  1968, 

[9]  Kyfcurg,  Henry  E.,  Jr.,  and  Smokier,  Howard  E.,  Studies  in  Ouhjeatisc  Frobahil'-  ., 
John  Wiley  and  Sons,  New  York,  1964. 

[10]  Lin,  Chi-Yuan,  and  Schick,  George  J. , "On-Line  (Console-Aided)  Assessment 
of  Prior  Distributions  for  Reliability  Problems,"  Annals  of  Fwli-ubilitj  v.d 
Maintainability,  Vol,  9,  1970. 

[11]  Lin,  Chi-Yuan,  and  Schick,  George  J.  , "Determination  of  Subjective  Prior 
Distribution  for  Bayesiari  Analysis  of  Maintainability  Problems,"  Anjials  of 
Reliability  and  Maintainability,  Vol.  13,  1974. 

[12]  Luce,  R.  D.  , and  Suppes,  P.  , "Preference,  Utility,  and  Subjective  Probability,” 
in  JIanfdbook  of  MaUicmutieal  tsyohology,  Vol.  3,  R.  D.  Luce,  R.  R.  Bush,  and 

E.  Galanter,  eds.,  pp.  249-410,  John  Wiley  and  Sons,  New  York,  1965. 

[13]  Morrison,  D.  G. , "Critique  of:  'Ranking  Procedures  and  Subjective  Probability 
Distributions',"  Mmayenent  Saicn-c,  Vol.  14,  pp.  B253-B254,  1967. 

[14]  Pratt,  J.  U. , Raiffa,  H. , and  Schlaifer,  R.  , Introduction  to  Statist  ioiV- 
jcoiaion  Th>-ory  (preliminary  edition),  McGraw-Hill,  New  York,  1965. 


-18- 


[15]  Raiffa,  Howard,  De-.risum  Introductory  La -tune a on  Choices  Undrv 

Uncertainty,  Addison-Wesley,  Reading,  Massachusetts,  1968, 

[16]  Raiffa,  Howard  and  Schlaifer,  Robert,  Applied  Statist-;  cal  Decision  7h>:orj, 
Harvard  University,  Division  of  Research,  Graduate  School  of  Business 
Administration,  Boston,  1961. 

[17]  Savage,  Leonard  J.  , The  Fuund..tionF  of  Statistics,  John  Wiley  and  Sons,  New 
York,  1954. 

[18]  Savage,  l.eonard  J. , "The  Elicitation  of  Personal  Probabilities  and 
Expectations,"  Joui’nai  of  the  Americxn  Statistical  Asso'ciatior.,  Vcl . 66, 
pp.  783-801,  1971. 

[19]  Schlaifer,  Robert,  Analysis  of  Decisions  Under  Uncertainty,  McGraw-Hill, 

New  York,  1969. 

[20]  Stael  von  Holstein,  Carl-Axel  5.,  Assesoncnt  rmd  L'valuation  of  SuDjectiar 
Probabil ity  Distributions , The  Economic  Research  Institute  at  the  Stockholm 
School  of  Economics,  Stockholii,  1970. 

[21]  Stael  von  Holstein,  Carl-Axel  S, , "Encoding  Subjective  Probabilities  for 
Decision  Analysis;  Practical  and  Experimental  Exnerience,"  presen^’ed  at  the 
Interdisciplinary  Coolcquim  on  Mathematics  in  the  P.ehavioral  Scineces,  UCIA, 
April  21,  1972. 

[22]  Stael  von  Holstein,  Carl-Axel  S.  , "A  Tutorial  in  Decision  Analysis,"  Unoublished 
manuscript,  Stanford  Research  Institute,  April,  1972. 

[23]  Winkler,  Robert  L. , "The  Assessment  of  Prior  Distributions  in  Bayesian 
Analysis,"  Journal  of  the  Anct-i  ■an  Statistical  Aesoai  rtion,  Voi.  52,  pp.  776- 
800,  1967. 

[24]  Winkler,  Robert  L. , "The  Quantification  of  Judgement:  Some  Methodological 
Suggestions,"  Joumai.  of  th-  .-in.-’j-iar;  Statistical  Association,  Vol,  62, 
pp.  1105-1120,  1967. 

[25]  Winkler,  Robert  L.,  "Probabi M s tic  Prediction:  Some  Experimental  Results," 

Journal  of  the  Ancrican  iul  Asscci.i  ion,  Vol.  66,  pp,  675-685,  1971. 


SE  C U R'  ^ * CL  • S*il  MT 


N Tm»S  PAi'.' 


t'  i»»i  Dmi  It  ► M 


REPORT  DOCUMENTATION  PAGE 


t H t P 0 R T N U M m P 


: ACCESSION  no 


KhAD  IN  TKo'CTIuNS 

1 I^Kt-OWK  rOMPLKriNC,  PE>KM 

)!  i R fiCi p a » At  p 

j(T^  U ^ -wp-y-  7>/'  ?7 fe 

Tv  TVP^  (t*"nFPO«t  » PERIOD  CO /t  BED 


' 1 1 _ t I wn*  fi  II  II 1 ».  » ▼>-r  « ►'Chi'ju 

OLCISION  ^KING  WITH  IHt ^IIJ  OF  Z'  mjLCnVEj  ^^tPchnical 

r»r»  t /\r\  r\rrTn»mtTT  AM  - - - “ ' ■*'  ' ^ 


PRIOR  DISTRIBUTION  , 


I A PrPEORMiNO  ORO  nCPOPT  Ni>s<eCM 


"»*  ^ MO«f  t I I 

George  J.^Schick  a*#  Chi -Yuar^Lin  ^ 


9 CONTRACI  or  r.RAj.^**-  nUMQFRm’ 


N00014-75-C-0733  > 


**  pepfORmsOOR'aniZa’ionnamF  *N0A0URC5S  |*0  PROGRAM  F,.  vMFnt  projEC  , ; A SK 

„ , AnrAAROR*<^’JNlTNUMpEH^ 

Department  of  Quantitative  Business  Anaiysislr 

University  oT  Southern  California  Task  Nr.  042-323 

los  Anglees,  California  9000?  ! 

’’  CON  T POLL  INC  QE  EICE  N AME  »NC  ADDRESS  TJ 

Office  of  Naval  Research  ,)uljp|J®76 

Statistics  & Probability  Program  Code  436  ' of  c ■ Srs  ” ■ "’  ' - 

Arlington,  Virginia  22217 I Rtdci 

^'A  MONtTOPiN  j AGFnCv  name  ^ from  Controlling  Ofl  rr.,  | 15  SECURITY  CLASS  fol  | 

I unclassified 

1 *5«  ' otcrASSi'FTCAnc'i  '6^a-.  sr'aoT^c 
I schedule 


•'Vr- 

^ pV--u*7tlWfi 


'.A  DiS’RieoTiOs  statement  (oI  thl%  Rrr^f'} 


Approved  for  public  release;  distribution  unlimited 


'7  Di*t«ipjTiON  5‘^ATEmEn^  fnt  tract  ant0forf  In  /flock  20,  H dll  tar  ant  Irom  fi  apart) 


’R  A E T WCRQ5  'Conlino*  on  tavaraa  alda  If  nacaaaary  tirtd  Idantlly  by  bloik  numhar) 


Bayesian  analysis 
I Subjective  prior  distributions 
l.ognormul  distribution 
Interactive  data  analysis 
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This  paper  ciscusses  a methodology  to  establish  a subjective  prior  distri- 
bution via  an  interactive  computer  program  on  a CRT.  The  program  asks  specific 
carefully  worded  questions.  The  answers  to  these  questions  are  checked  for 
logical  consistency  and  are  translated  into  fractiles  of  a subjective  probab- 
ility distribution.  The  fractiles  as  well  as  other  summary  measures  ( 1 i ke  the 
mean  and  variance)  are  printed  out.  In  order  to  find  a conjugate  prior  dis- 
tribution  for  a Bayesian  treatment,  the  mathematical  form  of  a possible— 
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'conjugate  prior  needs  to  be  ascertained.  The  paper  illustrates  how  the 
parameters  of  a lognormal  distribution  might  be  obtained  from  the 
fractiles  of  the  subjectively  derived  prior. 
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